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(54) Adaptive display speed automatic control device of motional video and method therefor 



(57) An automatic control device and method tor an 
adaptive display speed of a motion video is disclosed. 
The control dferice is capablo of adaptivoly controlling 
acceleration and speed change of a motion video 



according to the variation rate of the motion video within 
the interval of fast forward or slow motion modes. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

{0001] The present invention relates to a motion video system and method, and more particularly to an automatic 
speed control of a motion video display. 

Discussion of Related Art 

[0002] During a reproduction of a motion video, a user wishing to change the speed of the reproduction may enter a 
command to view the reproduction in fast forward or in slow motion. However, because the reproduction in fast forward 
or slow motion mode is maintained at a constant speed during such modes, the display speed may not satisfy a user's 
visual senses. 

[0003] For example, the motion video is quickly displayed in the fast forward mode regardless of whether the varia- 
tions of the scenes on the screen are high, making it difficult for a user to recognize or comprehend such portions of the 
motion video. On the other hand, when the variations of the scenes on the screen is low, even the quick speed of the 
fast forward mode may become tedious for a user. 

[0004] Similarly, the display speed of the motion video is slowed in the slow motion mode regardless of whether the 
scene variations on the screen are high. Thus, in such portions of the motion video, the user would visually feel as if the 
display speed has not changed even though the display speed has been slowed. However, when the scene variations 
are tow, the slowed display speed may be too slow making it tedious for the user. 

[0005] Typically, a fast forward mode is aimed to provide a high speed search and a slow motion mode to provide a 
detailed search for a specific scene or action in a motion video. Therefore, in consideration of the user's visual sensing 
capabilities, the speed Of display should be slower relative to the fixed display spaed in either the fast forward or slow 
motion modes when the variation of motion is high or when the scene changes are frequent in the motion video. On the 
other hand, the speed of display should be faster relative to the fixed display speed In either the fast forward or slow 
motion modes when the variation of motion is tow in the motion video 

[0006] However, because or tl le fixed display speed in both the conventional tast forward and slow motion modes, the 
sensing demands of the user as discussed above cannot be not met appropriately. Namely, if the motion video is dis- 
played in the fast forward or slow motion modes in the conventional device, the motion video is reproduced at a fixed 
speed, either fast or slow display speed. Accordingly, the user cannot dynamically display the motion video within the 
fast forward or slow motion mode. 

[0007] As a result, in the fast forward mode, the user cannot achieve a satisfactory reproduction at scenes of the 
motion video when the motion variation is minimal because of the rather slow screen changes. Likewise, the user would 
havo difficulty in searching for a particular seen© or action al scwnes of the motion video when the motion variation is 
high or when the scene changes are frequent because of the rather faster display speed than expected. 
[0008] In the slow forward mode, the user cannot achieve a satisfactory reproduction at scenes of the motion video 
when the motion variation is minimal because of the too slow screen changes. The user also cannot achieve a detailed 
display at scenes of the motion video when the motion variation is high or when the scene changes are frequent 
because of the rather fast screen changes 

SUMMARY OF THE INVENTION 

[0009] Accordingly, an object of the present invention is to solve at least the problems and disadvantages of the 
related art. 

[0010] An object of the invention is to provide an adaptive display of a motion video by automatically controlling the 
display speed of the motion video based upon the level of motion in the motion video. 

[0011] Additional advantages, objects, and features of the invention will be set forth in part in the description which 
follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or 
may be learned from practice of the invention. The objects and advantages of the invention may be realized and 
attained as particularly pointed out in the appended claims. 

[0012] To achieve the objects and in accordance with the purposes of the invention, as embodied and broadly 
described herein, an automatic control tor an adaptive Oispiay speed or a motion video and method thereof according 
to the present invention is characterized by changing a reproduction speed within a fast forward interval based upon the 
distance (or number of frames) between cuts, where the motion video Is in the fast forward mode; and changing the 
reproduction speed within a slow motion interval based upon the variation of motion in the motion video by detecting 
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image difference between the frames; such that the reproduction speed within the fast forward or slow motion interval 
can be dynamically controlled according to the features of the motion video, thereby satisfying a user's visual charac- 
teristic. 

5 PRIEF DESCRIPTION OF THE ATTAQHED D^AWINQS 

[001 3] The invention will be described in detail with reference to the following drawings in which like reference numer- 
als refer to like elements wherein: 

w FIG. 1 is a block diagram illustrating an automatic control device for an adaptive display speed of a motion video 
according to the present invention; and 

FIG. 2 is a flowchart illustrating an automatic control method for an adaptive display speed of a motion video 
according to the present invention. 

75 DETAILED DECRIPTION OF PREFERRED EMBODIMENT 

[001 4] Reference will now be made in detail to the preferred embodiments of the present invention, examples of which 
are illustrated in the accompanying drawings. 

[001 5] FIG. 1 is a block diagram illustrating an automatic control device for a dynamic display speed of a motion video 
20 according to the present invention. As shown in FIG. 1, the automatic control device comprises: a motion video file 101; 
a speed adjusting information detecting module 102 controlling a reproduction speed of the motion video file 101 during 
a fast forward (FF) or slow motion (SM) interval; a first storing module 103 storing a dynamic speed motion video data; 
a second storing module 104 storing a constant speed motion video data; and a display module 105 determining the 
variation of the motion video based upon the number of frames between the cuts and the difference image between the 
25 frames to momentarily increase/decrease a display speed within the fast forward (FF) or slow motion (SM) interval. 
[001 6} The speed adjusting information detecting module 1 02 further includes a cut detecting module 1 02a extracting 
cuts in the motion video and calculating the number of frames between two cuts to thereby detect variation of the motion 
video; and a difference video detecting module 1 02b obtaining a difference Image between the two frames in the motion 
video. 

w [0017] Particularly, the cut detecting module 102a extrautb and stuies the detected cuts fur deieimininy the change 
of scenes, the indexing of the detected cuts and the distance information (the number of frames) between the cuts. The 
difference video detecting module 102b detects the difference image between two adjacent frames, and stores the var- 
iation of the motion (video motion). 

[0018] For a fast display speed, the display module 105 has an algorithm relating the distance between the cuts to 
35 the display speed, by which the display speed can be dynamically adjusted according to the distance between the 
detected cuts. For a slow display speed, the display module 105 also has an algorithm relating the variation of the 
motion to the display speed, by which the display speed can bo dynamically adjusted according to the detected varia- 
tion of the motion. 

[001 9] FIG. 2 is a flowchart illustrating an automatic control method for the adaptive display speed of a motion video 
40 according to the present invention and an explanation of the method made in reference to FIG. 1 . 

[0020] In step 201 , the automatic control method reads a motion video file 101. Subsequently, the cut detecting mod- 
ule 102a and the difference video detecting module 102b simultaneously perform the cut detection and the difference 
image detection in steps 202 and 203. Afterwards, in step 204, the detected information is stored together with the orig- 
inal motion video file in the first and second storing modules 103 and 104, respectively. 
45 [0021 } Particularly, the cut detection in step 202 by the cut detecting module 1 02a is performed in the following man- 
ner. A cut is def ined as the points dividing the scenes of the motion video. A cut is detected when the displayed scene 
drastically changes, e.g. when the position and background are changed. The detected cuts are indexed, and the 
number ot frames between the cuts (distance information) are calculated and stored together with the motion video file 
in step 204. 

so [0022] The method (algorithm) for detecting such cuts and the number of frames between the cuts may be achieved 
by one of many existing algorithms. 

[0023] However, in the present invention a color histogram is used to obtain the distance information. Namely, a cut 
is detected between two consecutive frames when a difference of the color histograms corresponding to the two con- 
secutive frames is over a threshold value. The distance between the cuts, i.e. the distance information between two con- 
66 secutive cuts, is indicated by the nuntoei of frames between the two detected cuts. 

[0024] The position of the cut and the distance information between the cuts are stored as a new motion video tile in 
the second storing module 104 together with the original motion video file 101 of consecutive frames. One memory may 
be used for both the second storing module 104 and the lirst storing module 1 03 by appropriately distributing the mem- 
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ory area. The memory may store the data necessary tor either a FF or SM display interval in any manner. Moreover, 
the calculated skip frames or the period of frames which will be discussed below may be stored in the first module 103 
rather t^an the cut information and the distance information. 

[0025] The difference image detection in step 203 by the difference video detecting module 1 02b is performed in the 
a following manner. The size of the ditterence Image Is the difference in the motion between two adjacent frames. The 
difference image size is large when the motion between two frames is high or when the scene changes between two 
frames. Thus, the size of the difference image is obtained by subtracting the pixel values corresponding to the (n)th 
frame and the (n+1 )th frame. 

[0026] Afterwards, in step 204, the information of the difference image size is stored in the second storing module 104 
10 together with the original motion video file 1 0 1 of consecutive frames. As discussed above, the cut detection information 
and the difference image detection information are stored together with the original motion video file 101. 
[0027) Upon receiving a command for FF or SM from a user, a dynamic speed control Is possible by using The stored 
cut detection information and the difference video detection information. The dynamic speed control is performed in 
steps 205 through 210, by the display module 105 of FIG. 1. 
15 [0028J For the FF display speed, the number of skip frames is adjusted and the speed is adaptively controlled within 
the FF display interval. For SM display speed, the time period of the frames is changed and the speed is adaptively con- 
trolled within the SM display interval. 

[0029] An explanation of the operation for the dynamic speed control during the FF display mode selected by the user 
will next be given. If the user desires to display the motion video in the fast forward mode, the motion video is displayed 

20 at a relatively slower speed compared to the original FF display speed within the FF display interval when the variation 
displayed on the screen is last. If the variation displayed on the screen is minimal, the motion video is displayed at the 
relatively faster speed compared with the original FF display speed. Accordingly, the user can recognize a variation in 
the display speed, such that the user may search the motion video at the nearly constant recognition level. 
[0030] Since the number of skip frames is fixed in the conventional fast display speed of the motion video, the fast 

25 display is performed even in the interval with important frames, which fails to provide a detailed search to the user. As 
discussed above, however, the dynamic speed control method according to the present invention solves this problem. 
[0031 ] In the conventional fast display speed, the original frames are skipped at a constant interval, of about 5 frames, 
and displayed. In the present invention, the conventional fast or slow display is defined as a normal fast or slow display, 
and the adaptive acceleration/change speed display or the normal fast/slow speed display is selectively achieved 

jo according to the command ot The user. 

[0032] In step 205, a determination is made whether a user desires a FF display. If a FF display command is received, 
the display module 105 performs the display control in step 206 to achieve the adaptive acceleration/change speed con- 
trol for the FF display interval. Particularly, the number of skip frames is adjusted by the Algorithm of the following equa- 
tions: 

35 

Skip_k = integer [Di st (k) / (aDist (k) +b) ) . - . (1) 



40 If (Dist (k) <b) then Skip k = 1 ... (2) 

wherein, the 'SkipJ<' is the number of skip frames, which is applied to the frames between (k)th cut and (k+1)th cut, the 
'Dist(k)* represents the distance information (total number of frames) between the two consecutive cuts, a constant 'a' 
45 determines the degree of an automatic speed control according to the size of the Dist(k), a constant *b* defines a mini- 
mum display time required for displaying the distance between the cuts, and an 'integer' is an integer of the calculated 
value. 

[0033] If the distance between the cuts is shorter than the minimum display time *b\ the motion video is displayed at 
a normal speed by the equation (2), preventing the information of the displayed interval from being lost. Since the value 
so 'Dist(k)' and the constant values 'a' and 'b' are predetermined, when the distance between the cuts is long, i.e. the value 
'niet(k)' is high, the number of skip framoc 'Skip_k' increacos such that the motion video »e dicplayed at a relatively factor 
speed in the FF display interval. On the other hand, when the distance between the cuts is short, i.e. the value *Dist(k)' 
is low, the number of skip frames 'SkipJ*' decreases such that the motion is displayed at a relatively slower speed in 
the FF display interval. 

[0034] As the wnoie speea aajusting coefficient t)' and the relative speed adjusting coefficient 'a' are appropriately 
designated, the number of skip frames skipje* and the distance between the cuts are considered to thereby change the 
degree of the automatic speed control. When the constant 'a' Is V, ail the intervals between the cuts are displayed for 
the minimum display time b* regardless of the length of each interval, and when the constant "b % is *0\ all the interval?; 
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between the cuts are displayed at a speed faster than the normal display speed by a factor of 1/a. 
[0035] An explanation of the operation for the dynamic speed control during the SM display mode selected by the user 
will next be given. If the user desires to display the motion video at the slow display speed, such as when the motion in 
motion video is high, the motion video is displayed at the relatively slower speed compared with the original slow display 
5 speed within me SM display Interval. When the motion in motion video is low, the motion video is displayed at the rela- 
tively taster speed compared with the original slow display speed. Accordingly, the user recognizes a constant variation 
in the display speed, such that the user may performs a detailed search of the motion video at the nearly constant rec- 
ognition level. 

[0036] Since the period of the frame is fixed in the conventional slow display speed of the motion video, the slow dis- 
w play is performed even in the interval without important frames, which provides a tedious searching process to the user. 
As discussed above, however, the dynamic speed control method according to the present invention solves this prob- 
lem. 

[0037] In this case, the period of frame is defined as the time in which one frame is displayed on the screen and an 
original time period in the normal display mode will be expressed as Torig'. In the conventional slow display speed, the 
75 period of the frame is designated to be larger than that of the original frame period, thereby displaying the motion video 
at the slow display speed. In the presem invention, the conventional slow display is defined as a normal slow display, 
and one of the adaptive acceleration/change speed display or the normal slow display is selectively achieved according 
to the commands of the user. 

[0038] In step 207, a determination is made whether the user desires a SM display mode. If a slow display command 
zo is received from the user, the display module 1 05 performs the display control in step 208 to achieve the adaptive accel- 
eration/change speed control for the SM display interval. Particularly, the period of frame is adjusted by the algorithm 
of the following equations: 

T(n) = Torgi(n)*mDiff(n)*p 

25 

T(n) = Tmin. if T(n)< Tmin 

where T(n)' represents the changed period of an (n)th frame; the Torig' Is the original period of frame, e.g. 1/30 sec- 
onds In NTSC; the 'mDifffn)" is a size of difference image between the (n)th frame and the adjacent Irame; the Tmin' is 
30 a minimum period of frame which is dependant upon the device, and the "p* is a speed control coefficient for determining 
the degree of automatic speed control. 

[0039] The values Torig(n)*, 'Tmin', and *p' are predetermined and when the size of difference video 'mDiff(n)' is large, 
the period of frame T(n)' increases such that the motion video is displayed at a relatively slower speed in the SM dis- 
play interval. On the other hand, when the size of difference video mDiff(n)' is small, the period of frame T(n)' 

35 decreases such that the motion video is displayed at a relatively faster speed in the SM display interval. 

[0040] As the speed adjusting coefficient 'JV in the slow display algorithm is appropriately designated, the period of 
frame and the size of difference video are considered to change the degree of the automatic cpood control. 
[0041 ] The adaptive display speed automatic control within the FF or SM display interval is continued until stop com- 
mand is received from the user in step 209. If the stop command is selected, the change speed display stops in step 

40 21 0 and return to step 201 of reading the motion file. 

[0042] As discussed above, the automatic control device for an adaptive display speed of a motion video and method 
thereof is capable of dynamically controlling the speed of the motion video within the FF or SM interval in consideration 
of the user's visual characteristics, when the motion video is displayed in the fast or slow display speed. 
[0043] For example, in case of tho fact display speed, the user can search the motion video when the variation nf 

45 scenes is not drastic at relatively faster cfisplay speed, and the user can search the motion video when the variation of 
scenes is drastic at relatively slower display speed. 

[0044] On the other hand, in case of the slow display speed, the user can search the motion video when the variation 
of motion is not drastic at relatively taster display speed, and tne user can search the motion video when the variation 
of motion is drastic at relatively slower display speed, 
so [0045] If the motion video is displayed at the relatively faster or slower display speed than the conventional fast or slow 
speed within the FF or SM interval the user can enjoy a detailed search of the motion video where variation of motion 
is dynamic such as a sports broadcasting program, and a high speed search of the motion video where variation of 
motion is static such as a concert program. 

[0046] In addition, the present invention can selectively perform the existing normal fast or normal slow display as well 
56 as the adaptive acceleration/change speed control, in which the degree of speed change is determined by the estab- 
lishment of the automatic speed control coefficients, thereby achieving the reproduction speed to satisfy an object of a 
user's search. 

[0047] The foregoing embodiments are merely exemplary and are not to be construed as limiting the present inven- 
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tion. The present teachings can be readily applied to other types of apparatuses. The description of the present inverv 
tron is intended to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications and variations 
will be apparent to those skilled in the art. 

Claims 

1 . An automatic control device for adaptive display speed of a motion video, comprising: 

a motion video detecting unit detecting cuts in a received motion video file and detecting the number of frames 
between the cute, and obtaining a difference image between the frames in the motion video file; and 
a memory storing a new motion video data containing the detected cut information and the difference image 
information, said memory also storing the original motion video tile received. 

2. A device of claim 1 . further comprising: 

a display module displaying the motion video at a variable display speed according to the new motion video 
data and the original motion video data stored in the memory. 

3. The device Of claim 2. wherein the displaying module displays the motion video at a variable speed faster than a 
normal display speed during a fast forward display; wherein the variable speed is determined based upon the 
number of frames between cuts. 

4. The device of claim 3. wherein the variable speed is controlled by a number of skip frames and wherein the number 
of skip frames is based upon the number of frames between cuts. 

5. The device of claim 4, wherein the number of skip frames is adjusted by the following equation: 

Skip_k = integer[Dist(k)/(aDist(k)+b)] 

where the '6kip_k' is the number of skip fiames for the frames Oetween (K)th cut and (k+1)th cut, the Dist(k)' rep- 
resents the total number of Irames between two consecutive cuts, 'a' is a predetermined constant, V is a predeter- 
mined constant, and an 'integer' is an integer of the calculated value. 

6. The device Of claim 5. wherein if the constant 'a' is *0'. all the intervals between the cuts are displayed for the min- 
imum display time 'b' regardless of the length of each interval, and if the constant V is X>\ all the intervals between 
the cuts are displayed at the faster display speed by 1/a than the speed in the normal display 

7. The device of claim 1 , wherein the motion video detecting unit comprises: 

40 a cut detecting module detecting cuts in the motion video file and detecting the number of frames between the 

cuts; and 

a difference image detecting module obtaining a difference image between the frames in the motion video file. 

8. The device of claim 1 . wherein the memory comprises: 



25 



35 



45 



a first storing module storing the new motion video data containing the detected cut information; and 

a second storing module storing the difference image information, said memory also storing the original motbn 

video file received. 

so 9. The device of cfaim 1 , wherein the displaying module displays the motion video at a variable speed slower than a 
normal display speed during a slow motion display: wherein the variable speed is determined based upon a size of 
the difference image. 

1 0. The device of claim 9, wherein the variable speed is controlled by a period of frame and wherein the period of frame 
h ic baced upon the number of frames between cuts. 

11 . The device of claim 1 0, wherein the period of trame is adjusted by the following equation: 
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T(n) = Torgi(n)*mDiff(n)*p 
T*(n) = Tmin, It T(n)< Tmin 

6 where T(n)' represents the changed period of an (n)th frame; the long" is the original period of frame, the YnDiff(n)' 

is a size of difference image between the (n)th frame and the adjacent frame; the Tmin' is a minimum period of 
frame; and the '(V is a predetermined constant. 

12. An automatic control method for adaptive display speed of a motion video, comprising the steps of: 

10 

(a) detecting cuts in a received motion video file and detecting the number of frames between the cuts, and 
obtaining a difference image between the frames in the motion video file; and 

(b) storing a new motion video data containing the detected cut information and the difference image informa- 
tion, and the original motion video file received. 

15 

13. The method of claim 12, further comprising the step of: 

(c) displaying the motion video at a variable display speed according to the new motion video data and the orig- 
inal motion video data. 

20 

14. The method of daim 13, wherein step (c) comprises the step of displaying the motion video at a variable speed 
faster than a normal display speed during a fast forward ofeplay; wherein the variable speed is determined based 
upon the number of frames between cuts. 

25 15. The method of claim 14. wherein the variable speed is controlled by a number of skip frames and wherein the 
number of skip frames is based upon the number of frames between cuts. 

16. The method of claim 1 5, wherein the number of skip frames te adjusted by the following equation: 

w 3kip_h = integer[Dist(k)/(aDisl(k)+b)] 

where the 'Skip_k' is the number of skip frames for the frames between (k)th cut and (k+1)th cut, the 'Disttk)' rep- 
resents the total number of frames between two consecutive cuts, 'a' is a predetermined constant, t>' is a predeter- 
mined constant, and an 'integer' is an integer of the calculated value. 

17. The method of claim 16, wherein if the constant 'a* is '0\ displaying all the intervals between the cuts for the mini* 
mum display time V regard) ©33 of the length of each interval, and if tho constant V is X>\ displaying all the intervals 
between the cuts at the faster display speed by 1/a than the speed in the normal display. 

40 18. A method of claim 12, wherein the step of detecting cuts in step (a) comprises the steps of: 
building a color histogram for each frame of the motion video data; and 

designating a cut when a difference of the color histograms corresponding to the two consecutive frames is 
over a predetermined threshold value. 

45 

19. A method of claim 12, wherein the step of obtaining the difference image in step (a) comprises the step of subtract- 
ing the pixel values corresponding to the (n)th frame and the (n+1)th frame. 

20. The method of claim 12, wherein step (c) comprises the step of displaying the motion video at a variable speed 
so slower than a normal display speed during a slow motion display; wherein the variable speed is determined based 

upon a size of the difference image. 

21. The device of claim 20, wherein the variable speed is controlled by a period of frame and wherein the period of 
frame is based upon the number of frames between cuts. 

55 

22. The device of claim 21 , wherein the period of frame is adjusted by the following equation: 

T(n) = Torgi(n)*mDiff(n)*p 
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T(n) = Tmin, if T(n)< Tmin 

where T(n)' represents the changed period of an (n)th frame; the Torig 1 is the original period of frame; the , mDiff(n)' 
is a size of difference image between the (n)th frame and the adjacent frame; the Tmin' is a minimum period of 
frame; and the p* ia a predetermined constant. 
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